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CMMv1.1  Measurement  Map 


Abstract:  This  report  identifies  and  tabulates  all  references  to  software 
measures  and  measurement  activities  that  appear  in  Version  1.1  of  the 
Capability  Maturity  Model^m  for  Software  (CMMsm).  Each  reference  is  listed 
in  a  structured  format,  and  the  results  are  sorted  into  topic  areas  in  a  way  that 
is  designed  to  help  organizations  plan  the  evolution  of  their  measurement 
activities  across  the  key  process  areas  of  the  CMM.  Where  the  CMM’s 
guidance  is  unclear  or  incomplete,  opportunities  for  improving  the  CMM  are 
noted  and  explained. 


1  Overview 


Genesis  and  Structure 

This  report  is  the  result  of  the  author’s  attempt  to  identify  all  references  to  software 
measures  and  measurement  activities  that  occur  in  Version  1.1  of  the  Capability  Maturity 
Model  for  Software  (CMM)  [Paulk  93a,  93b,  95].  It  presents  a  table  that  sorts  the  CMM’s 
statements  with  respect  to  measurement  into  related  topics  and  maps  the  sequencing  of 
measurement  activities  across  the  levels  of  the  CMM.  The  measurement  map  is  presented 
in  three  parts,  as  follows: 

Part  1 — ^The  Software  Process:  Measures  and  Things 
To  Be  Measured 

(Measures  and  activities  associated  with  the 
software  process  itself) 

Part  2 — Key  Process  Areas  and  Activities 

(Measures  and  activities  related  to  individual 
key  process  areas  of  the  CMM) 

Part  3 — ^The  Software  Process  Database 

(Statements  that  the  CMM  makes  relative  to 
data  to  be  saved  and  activities  associated 
with  the  software  process  database) 

The  first  page  of  each  part  lists  the  topics  within  that  part  of  the  measurement  map  and 
shows  the  page  numbers  within  the  map  where  the  topics  can  be  found. 


Pages  7-21 


Pages  22-48 


Pages  49-52 


s"’  CMM  and  Capability  Maturity  Model  are  service  marks  of  Carnegie  Mellon  University. 
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Prerequisites 

Users  of  this  report  and  of  the  measurement  map  are  presumed  to  have  a  basic  familiarity 
with  the  CMM. 


Objectives 

The  measurement  map  of  the  CMM  was  prepared  with  the  following  objectives  in  mind. 

1 .  Consolidate  and  organize  the  guidance  that  the  CMM  provides  with  respect 
to  software  measurement. 

2.  Provide  a  systematic  listing  of  measures  and  measurement  activities  that 
can  help  organizations  assess  the  coverage  and  effectiveness  of  their 
software  measurement  practices,  as  they  relate  to  the  goals  and  key 
process  areas  of  the  CMM. 

3.  Identify  and  summarize  the  evolutionary  progression  of  measurement 
activities  that  the  CMM  envisions  as  organizations  progress  to  higher  levels 
of  process  maturity. 

4.  Help  organizations  introduce  software  measures  and  measurement 
activities  in  ways  that  support  a  smooth  progression  up  the  maturity  ladder. 

5.  Help  practitioners  identify  where  measures  and  measurement  practices  can 
be  used  for  multiple  purposes,  so  that  economies  in  measurement  can  be 
achieved. 

6.  Identify  ways  in  which  the  CMM’s  treatment  of  software  measurement  can 
be  improved  as  the  CMM  evolves  toward  Version  2.0. 


Current  Applications 

One  major  U.S.  company  with  multiple  sites  and  multiple  lines  of  business  is  using  the  CMM 
measurement  map  in  this  report  to  provide  a  structure  for  assessing  the  measurement 
practices  of  its  various  software  organizations.  Extracts  from  the  map  are  providing  the 
baselines  against  which  coverage  and  effectiveness  of  local  measurement  activities  are 
being  evaluated.  The  company’s  first  objective  is  to  understand  where  each  operating 
organization  stands  with  respect  to  installing  and  using  measures  that  support  their  planned 
progressions  to  higher  maturity  levels.  Its  second  objective  is  to  identify  opportunities  for 
improving  its  measurement  processes  and  practices. 


improving  the  CMM 

In  pulling  the  summary  table  together,  numerous  opportunities  for  improving  the  correctness, 
completeness,  clarity,  and  consistency  of  the  CMM’s  treatment  of  measurement  and 
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statistical  methods  became  apparent.  These  opportunities  have  been  noted  and  explained 
in  the  comments  within  the  table.  The  potential  areas  for  improvement  include 

•  making  terminology,  requirements,  and  examples  of  software  measures 
and  measurement  activities  internally  consistent 

•  eliminating  impossible  or  unproductive  requirements  and  examples 

•  eliminating  redundancies 

•  coordinating  measures  and  measurement  activities  among  key  process 
areas,  so  that  economies  in  collecting,  storing,  analyzing,  and  reporting 
measurement  results  can  be  achieved 

•  identifying  closely  related  measures  and  measurement  activities,  so  that 
opportunities  for  commonality  and  sharing  can  be  exploited 

•  improving  the  evolutionary  path  of  measurement  practices  across  CMM 
maturity  levels,  so  that  measurement  activities  that  appear  useful  for 
Levels  2  and  3  do  not  turn  out  to  be  counterproductive  at  Levels  4  and  5 

•  correcting  errors  and  misunderstandings  in  the  CMM’s  references  to 
statistical  methods  and  in  its  discussions  of  the  use  of  control  charts  and 
statistical  process  control  for  managing  and  improving  software  processes 

•  improving  coverage  (Some  important  aspects  related  to  measurement  and 
the  use  of  measurement  results  were  found  missing.  These  are  identified 
and  explained.) 

•  improving  the  clarity  and  correctness  of  the  presentation  and  discussion  of 
measurement  issues 

•  providing  guidelines  and  advice  for  the  quantitative  and  operational 
aspects  of  software  process  databases,  so  that  the  databases  may  more 
effectively  serve  the  estimating,  planning,  and  process  improvement  needs 
of  software  organizations 

The  measurement  map,  together  with  and  the  comments  and  recommendations  it  contains, 
is  being  used  as  an  input  to  the  development  of  Version  2.0  of  the  CMM. 
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2  The  Measurement  Map 


Format  and  Notation 

Column  One  of  the  measurement  map  lists  the  actions,  measures,  indicators,  and 
requirements  for  measurement  that  are  mentioned  in  Version  1.1  of  the  CMM.  Bold-faced 
type  highlights  specific  measures  and  things  to  be  measured. 

Column  two  identifies  the  locations  in  the  CMM  where  the  references  occur  (sometimes 
there  is  more  than  one  reference).  The  notation  used  is  shown  below.  With  this  notation, 
entries  such  as  “PP  A7.5,  PR  Ab3”  show  that  the  item  was  mentioned  in  Activity  7.5  of  the 
Software  Project  Planning  KPA  and  in  Ability  3  of  the  Peer  Reviews  KPA. 


Key  Process  Area  (KPA) 

Level  2 

RM 

Requirements  Management 

PP 

Software  Project  Planning 

PTO 

Software  Project  Tracking  and  Oversight 

SM 

Software  Subcontract  Management 

SQA 

Software  Quality  Assurance 

SCM 

Software  Configuration  Management 

Level  3 

OPF 

Organizational  Process  Focus 

OPD 

Organizational  Process  Definition 

TP 

Training  Program 

IM 

Integrated  Software  Management 

PE 

Software  Product  Engineering 

IG 

Intergroup  Coordination 

PR 

Peer  Reviews 

Level  4 

QPM 

Quantitative  Process  Management 

QM 

Software  Quality  Management 

Level  5 

DP 

Defect  Prevention 

TCM 

Technology  Change  Management 

PCM 

Process  Change  Management 

CMU/SEI-96-SR-003 
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Symbol 

Section  of  the  Key  Process  Area 

G 

Goals 

C 

Commitment  to  perform 

Ab 

Ability  to  perform 

A 

Activities  performed 

M 

Measurement  and  analysis 

V 

Verifying  implementation 

Column  3  of  the  measurement  map  contains  notes,  observations,  clarifications,  and 
recommendations  that  represent  the  views  of  the  author. 

Columns  4-7  identify  the  categories  into  which  the  measures  or  activities  fall.  The  notation 
used  is  as  follows: 


Category 

R 

A  required  measure  or  action 

I 

Implied  by  a  required  measure  or  action 

T 

Classified  by  the  CMM  as  a  typical  measure 

or  action  (i.e.,  alternatives  are  permitted) 

E 

Cited  by  the  CMM  as  an  example  of  a 

representative  measure  or  action 

X 

Implied  by  an  example  measure  or  action 

Users  of  the  measurement  map  should  keep  in  mind  that  the  CMM  contains  no 
requirements.  It  is  purely  a  descriptive  model,  not  a  prescriptive  one.  The  author’s  use  of 
the  term  “required”  in  this  report  should  be  interpreted  in  the  sense  that  the  measure  or 
action  is  required  if  an  organization  is  to  be  considered  compliant  with  the  CMM. 


The  CMM’s  View  of  Software  Measurement 

The  measurement  map  is  presented  on  the  pages  that  follow.  It  consists  of  three  parts,  as 
shown  below.  The  topics  in  each  part  are  listed  on  the  first  page  of  the  part. 

Part  1 :  The  Software  Process— Measures  and  Things  to  Be 

Measured  Page  7 

Part  2:  Key  Process  Areas  and  Activities  Page  22 

Part  3:  The  Software  Process  Database  Page  49 
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CMM  v1.1  Measurement  Map 

Part  1 

The  Software  Process: 
Measures  and  Things  to  Be  Measured 


Topic 

Page 

Size 

8 

Complexity 

9 

Reuse 

10 

Computer  Resources 

10 

Support  Facilities 

11 

Effort 

11 

Staffing 

12 

Schedule 

13 

Cost 

16 

Productivity 

17 

Risk 

18 

Testing 

18 

Scrap  and  Rework 

18 

Quality  (organizational  focus) 

19 

Quality  (project  focus) 

19 

CMU/SEI-96-SR-003 


7 


CMM  v1.1  Measurement  Map 


a.  o 
»-  o 
o  0. 


OS 
O  GLS 


Q.  CC 
-  O 
O.  lU 

-s 

H  CL 

O  0.  Q 
O  0.  IL 


»  OS 

«  o< 

CAS 
Q.  H  O 
O.  D. 

ocs 


£ 

V 

CE 


S  o 

s  < 


s:  w 

oiS 

15  £ 


I  £  - 
i  I  $ 


o 

®  15 


2 

S'  o 

.9  (0  0)  c 

?  8  g  8 

<  ll  ? 
■  "II 


e 

-g 


C  tt> 


■O  -Cf 


,  fc  0)  "D 

9  >  c 


O  V. 
a>  o 

g>  • 

1  ?■ 


«  ® 
m  ^ 
w  « 

2"  « 

o 

S  Q- 
O  2 


Q.  2  •£ 

E  "  « 

«  -2  E 

S  >'-0  ® 

2  S  -  I 

«  <U  2 

«  ^  S 


S  «  • 
^  ^ 

•So  8 

S  o-S 


CM  x>  «  « 


eI 


.9  «  -2 
"5  o»  £ 
c  ®  ^ 

■j  ^ 

CO  w  o 

^  E  5 


If)  ~ 

^  iri 
0.  < 
o-  Q 


O) 

<  C\i  CM  CM  CO  W 

*  If)  iri  If)  iri  ^  5 

“1  <  <  <  <  ^  < 

^  £L  0.  £L  D.  O 


I 

T3 

g 

a 

I 

S 


?  I 


2 


c 

o 

s 

c 

0) 

E 

3 
I  O 
J  O 
p  XJ 


A  0) 

c 


jlf 

^  P  £ 


”  -  D).?  TJ  ^  ^  c 

5  S'S'SoilS 


I  1 

CD  a 

1  E 


8>lf 
*5  *5  o 

2  J  s 
ill 


«  « 
c  o 


llSl 
s s 8 Si^  . 

(A  CA  CA  (A  3  O)  (A 


®  0.1 
2  0) 


iri  in 

<  < 


gg| 

0-  Q. 


il 


*2  « 
o  C 
5  o 


o 
w 

O  -  :§ 


o  tS 

^  o 

o  ^ 

p  ® 


'•o 
2 
u 
® 

1^2 

® 

go:  8 

CA  (A 


LULLILLILliLU  LULULLIUJIiJUJ 


1^ 

B- 

f-  «- 

T- 

<T.- 

1 

IS 

CN 

CO 

Tf 

ID 

Icj) 

C7> 

c?> 

0) 

O)  o> 

CJ)  o> 

o> 

O) 

o> 

o> 

o> 

ai 

Cl) 

O) 

o> 

< 

< 

< 

<  < 

<  < 

< 

< 

< 

< 

In 

< 

< 

< 

< 

< 

CL 

0- 

0. 

0. 

CL  0. 

CL  CL 

(L 

CL 

CL 

CL 

1  CL 

CL 

CL 

IL 

CL 

CL 

lo. 

CL 

CL 

QL 

CL  CL 

IL  CL 

CL 

CL 

CL 

CL 

,CL 

CL 

CL 

0. 

CL 

CL 

2  « 

l§ll  - 

O  •s  "O 
O  n  O  Q 

«  “  fi.  8 

o  o  2  o 

I  ®  u  ^  g 

'tl 


S  .. 

=  1  = 

ill 

^  ^  Q. 

o  o  ^ 

^li 

E  E  •o 


i  g  g 


C  C  0) 

•  ■  .5: 


2 

«  Q. 
$  ®  ^ 

°  ll 

W  J  S 
15  o  ® 

C  CO 

o  t;  « 

Eg.? 

®  d  ;= 

S-  =  ^ 

O  <0  TJ 


.il 

s  ^ 

g  O. 

E  -2 

3  O 

O  ^ 
■D  O) 

®  15 

0)  TJ 

il 

=>  ? 

I  ” 

Q.  d> 

i, 

CO  o 

1  S  s 

•o  2  > 

^1# 
>  c  2 
*  o  > 

2  §£ 


1*1 

o  o  B 

c:  CO  ® 


.9  Q. 

% 

o  c 

E 

te  ® 

g  S  S 

-IS 

lit 

~  os  <0 

«  3  ® 

I  a 

a>  2  « 

c  D>  2 

C  3 
ago) 


.2  ®  « 
£D  « 
O  -  (I) 

'^3*  g  I 

■  ‘w  cm' 

g  'B  5 

g  CO  < 

(A 


£  0)  w 
5  £  .9 

3=  ■>“  O 
k.  CO  «. 
®  Q.  C 

x:  «  ® 
15  ■£  c 
.X^  w 

T)  ,12 

-  cf  ® 

S  'I  E 

.12  df 
o)  E  :z 

I  8| 

f«  I 

5  i’.i 

O  CD 
CO  ^ 

Hi 

®  E  ^ 

E  I  I 

8  20 


¥ 


.> 

ts 


B 

3 

I 

d 

•2 

o 


»  8 
Sis 
E  TS  ® 
g  2  £ 
5  0-0, 
^  -2  15 
Woe 

CD  J 
CO  CO 
LU 


«  CO  .i 
B  £  w 
3  .2  ® 

o  1-  i 
fe.  .  E  .9 

ts  s  s 

i  :8 "  -S 

>  T5  2=  c 
®  o  ®  ® 
CO  'c; 

as  g  s 

l|  I  E 

O  3  3 

U  ®  U  U 
CD  CO  O  O 

Q  D  O  Q 


Measures  and  things  to  be  measured  are  shown  in  bold  face.  R  =  Required  I  =  Implied  T  =  Typical  E  =  Example  X  =  Implied  by  Example 

Page  8 


Measures  and  things  to  be  measured  are  shown  in  bold  face.  R  =  Required  I  =  Implied  T  =  Typical  E  =  Example  X  =  Implied  by  Example 

Page  10 


CMM  v1.1  Measurement  Map 


Ol  o  s 

o 

a  a. 


o 

O  Q.  S 


0.  oc 
-o 
a.  uj 

H  D. 
O  0.  O 
O  0.  U. 


ICO  o  Z 

j(0  0< 

(OZ 
0.  H  O 
0.  0. 
oc  Z 


s 

c 


II 

li 

t! 

II 


I 

o 

I 

V 

c 

£ 

3 


go 

U  ^ 


^  ^ 
<  <  < 
CL  CL  0- 


III 


)  UJ 


OC 

oc 


k- 

0)  "D  O  ■ 

Vi  2  ^  ' 

I  «  S  S  1 1 

M|f8 

a  =  lE  ^  ® 

C  2  OT 

C  Q.  c 
«  cn.2 

c  .£  « 
c:  N  3 

-II 

slc- 
«  °  i 
?  *2  ^  2  "  ■ 
tifll' 


£ 

£5 

:  c 
2  ■ 
i  « 


<!}►-£ 

®  £  o 
C  0)  o 

I 

SE  2 
|.^2 


£  w  t3  ■ 


•I  « 

I  « 

1-5  k*, 

w  I  i  £ 

o 

U- 


O)  -5  « 

.c=  2  - 

I  f  I 

Ti  O  fli 


I  “ 

I  s 

II 


§>*§  E 

‘■§11 

lls. 

—  0)  o 

®  S  «  2 

=  1  il 


c.  .bj 
0)  </) 
cn  I- 


E£ 


.2  ® 


CO 

o 

<  _  CO  CO  CNJ 

•*.  5  S  ci  r  C>  d 

!>:  CO  n  <  ^  <  < 


CO 


d  o  c>  ^  , 


1  *“ 

^  ^  ^  ^  ^  ^ 

<  <  <  rj  <  < 

CL  CL  CL  ^  Z  Z 

CL  CL  CL  CL - 


d  S  ”  ”  « 

CL  ^  Z  Z  Z 
CL  O - 


CO  CO 
n  X) 
<  < 


E 

■■5 


I 

a 


CD 


(U 

f 

s 

TJ 


r 

o 

? 

s 

I 


Q  -c  ©  W 

c  Q.xa  o 

■c  I  2  S 

£  &  Q  ‘c 
§“  <0  Q-  o 

w  ©  ©  E  © 

s  s  I  -i  ^ 
“>  2.  ?  «  2 
T3  c  to  ■«  JS 

I  SP  8'  f 

ill 

8  I  O  = 
•a  2  «  E  O 
to  -  - 


S) 

g 

■g 


o 

o 

0) 

N 

« 

£  I 


If 

”1 

to  ^  w 

E  g^o 


a£ 

i  I 


II- 

i  >  > 
}  ©  © 
;  £  "o 

i  ra 


©  t3  g 

Is"- 

©  ©  £ 
>^22 
0)  *  => 
"D  o  i2 

£  ^  -S 

ill 

2  ©  ^ 
‘  ©  £  cr 
£  .i  o 

-  CO  ^  ^ 

>  ©  £  « 

>  «  -o  > 

;-l  S  fe 


«  £ 

11 

CO  to  , 

iUii 

o»  t 


s 

g 

a 

E 

«  £ 
9>  " 

D)  o 
£  2 
M  to 

M 


0)  © 

-D  x: 

to  ^ 

E I  s 

g>  >  ^ 
(0 


a  o>  ! 


I  8  > 

.  a> 


to  2 

E  -o  g 

c  C 


2  S  « 

c 
to 


©  S  «  ^  © 

ilflis 

s  w  P  O  £.  o 
C  Q>  ©  '«  C  5;. 


pi 

II 

n 

a  c 


SI  ra 

a  a 


I g  I  ^ 

tocccffix:,^ 

a><j}Q)Q>j-—  ci! 

©EEEr:£®£ 


©  ©  © 
«j  lU  (0  (A  (A 

D  CD  D  D  D 


E  r  £ 

>  :o  CL  to 

>  o  <0  XJ 

>  p  T3  a 

>  Q  <  D 


^  s  ©  ■ 

C)  3  n 
>  A  c  ' 

Sil 


■c  t  t 
000 


i-  © 

£  - 

0  0 

f| 

II 

|:g 

1 1 

«  z. 
S  B 

II 

^  u 
s  © 
jO  u. 

1 1 

£  £ 
111  UJ 

UJ 

z  z  z  z  = 

<  Z  U-  U.  ^ 
o  O  CL  OL  Z 

(/>(/)  o  o 


1 

5 

2 

a 


c 

© 

E  t> 

a  © 


S  I  5. 


V  O) 

o  n 

o  c 


Iflll 

c  c  ^  X  Z. 

CO  «  p  p  p 

la  a  I  I  I 


C  t 
o  o 


a  a  a 


^  -  r  t  t 

<  Z  o  o  o 

O  O  a:  fc  *: 

|(0  CO  UJ  lU  UJ 


Measures  and  things  to  be  measured  are  shown  in  bold  face.  R  =  Required  I  =  Implied  T  =  Typical  E  =  Example  X  =  Implied  by  Example 

Page  1 1 


staffing  (actual)  PTO  A6.3,  IM  A5.1 

Compare  to  plan.  PTO  A6.3  Implies  need  for  periodic  measurement  &  reporting 

Document  all  staffing  changes  that  affect  commitments.  PTO  A6.4 
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Organizational  productivity  trends  PCM  A9.3  Normalization  mechanisms  are  needed. 

Productivity  of  software  process  development  PCM  A9.3  ??  This  seems  like  an  excessive  requirement. 

Productivity  of  software  process  improvement  PCM  A9.3  ??  This  seems  like  an  excessive  requirement. 

Expected  productivity  benefits  of  process  improvement  proposals  PCM  A5.3 
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proeJuds.  "Requirements'  section  of  this  mapping. 

Measurements  are  made  and  used  to  determine  the  status  of  software  product  PE  M2  The  examples  the  CMM  gives  for  status  measures  are 

engineering  activities.  listed  with  their  related  items  in  preceding  sections. 
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by  guidance  that  makes  this  clear. 

Also,  adjustment  alone  is  unlikely  to  help.  It  is  almost 
always  more  effective  to  focus  on  identifying 
assignable  causes  and  removing  them,  then  work  on 
process  improvement. 
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•  applying  basic  quantitative  methods  and  analysis  techniques,  such  as  QPM  Ab4 

estimation  models,  Pareto  diagrams,  and  control  charts 
All  members  of  the  software  engineering  group  and  related  groups  receive  orientation  QPM  Ab4 

on  the  value  and  goals  of  quantitative  process  management. 
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